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Abstract 

.Spectrum sensing is a fundamental component is a cogni- 
tive radio. In this paper, we propose new sensing methods 
ibased on the eigenvalues of the covariance matrix of sig- 
■nals received at the secondary users. In particular, two 
'sensing algorithms are suggested, one is based on the ra- 
tio of the maximum eigenvalue to minimum eigenvalue; the 
pther is based on the ratio of the average eigenvalue to mini- 
mum eigenvalue. Using some latest random matrix theories 
'(RMT), we quantify the distributions of these ratios and 
■derive the probabilities of false alarm and probabilities of 
^detection for the proposed algorithms. We also find the 
thresholds of the methods for a given probability of false 
alarm. The proposed methods overcome the noise uncer- 
tainty problem, and can even perform better than the ideal 
lenergy detection when the signals to be detected are highly 
•correlated. The methods can be used for various signal 
'detection applications without requiring the knowledge of 
•signal, channel and noise power. Simulations based on ran- 
'domly generated signals, wireless microphone signals and 
■captured ATSC DTV signals are presented to verify the ef- 
fectiveness of the proposed methods. 

■ Key words: Signal detection. Spectrum sensing, Sensing 
algorithm, Cognitive radio. Random matrix. Eigenvalues, 
IEEE 802.22 Wireless regional area networks (WRAN) 



1 Introduction 

A "Cognitive Radio" senses the spectral environment over a 
wide range of frequency bands and exploits the temporally 
unoccupied bands for opportunistic wireless transmissions 
[11 m [3] . Since a cognitive radio operates as a secondary 
user which does not have primary rights to any pre-assigned 
frequency bands, it is necessary for it to dynamically de- 
tect the presence of primary users. In December 2003, the 
FCC issued a Notice of Proposed Rule Making that iden- 
tifies cognitive radio as the candidate for implementing ne- 
gotiated/opportunistic spectrum sharing In response to 
this, in 2004, the IEEE formed the 802.22 Working Group 
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to develop a standard for wireless regional area networks 
(WRAN) based on cognitive radio technology [5j. WRAN 
systems will operate on unused VHF/UHF bands that are 
originally allocated for TV broadcasting services and other 
services such as wireless microphone, which are called pri- 
mary users. In order to avoid interfering with the primary 
services, a WRAN system is required to periodically detect 
if there are active primary users around that region. 

As discussed above, spectrum sensing is a fundamental 
component in a cognitive radio. There are however several 
factors which make the sensing problem difficult to solve. 
First, the signal-to-noise ratio (SNR) of the primary users 
received at the secondary receivers may be very low. For ex- 
ample, in WRAN, the target detection SNR level at worst 
case is — 20dB. Secondly, fading and time dispersion of the 
wireless channel may complicate the sensing problem. In 
particular, fading will cause the received signal power fluc- 
tuating dramatically, while unknown time dispersed channel 
will cause coherent detection unreliable O [71 [8] . Thirdly, 
the noise/interference level changes with time which results 
in noise uncertainty [HI [SI HH] ■ There are two types of noise 
uncertainty: receiver device noise uncertainty and environ- 
ment noise uncertainty. The sources of receiver device noise 
uncertainty include [6lll0j: (a) non-linearity of components; 
and (b) thermal noise in components, which is non- uniform 
and time-varying. The environment noise uncertainty may 
be caused by transmissions of other users, including near-by 
unintentional transmissions and far-away intentional trans- 
missions. Because of the noise uncertainty, in practice, it is 
very difficult to obtain the accurate noise power. 

There have been several sensing algorithms including the 
energy detection [Til El lEl [3 [10], the matched filtering 
Ha [61 [g [7] and cyclostationary detection [l3 l fli l [T5 l [TB] . 
each having different operational requirements, advantages 
and disadvantages. For example, cyclostationary detection 
requires the knowledge of cyclic frequencies of the primary 
users, and matched filtering needs to know the waveforms 
and channels of the primary users. On the other hand, en- 
ergy detection does not need any information of the signal 
to be detected and is robust to unknown dispersive chan- 
nel. However, energy detection relies on the knowledge 
of accurate noise power, and inaccurate estimation of the 
noise power leads to SNR wall and high probability of false 
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alarm [HI [IHl [IZ] ■ Thus energy detection is vulnerable to 
the noise uncertainty [HI UHl 13 • Finally, while energy de- 
tection is optimal for detecting independent and identically 
distributed (iid) signal [12], it is not optimal for detecting 
correlated signal, which is the case for most practical appli- 
cations. 

To overcome the shortcomings of energy detection, in this 
paper, we propose new methods based on the eigenvalues of 
the covariance matrix of the received signal. It is shown 
that the ratio of the maximum or average eigenvalue to the 
minimum eigenvalue can be used to detect the the presence 
of the signal. Based on some latest random matrix theories 
(RMT) [m (HI [201 [21], we quantify the distributions of these 
ratios and find the detection thresholds for the proposed de- 
tection algorithms. The probability of false alarm and prob- 
ability of detection are also derived by using the RMT. The 
proposed methods overcome the noise uncertainty problem 
and can even perform better than energy detection when the 
signals to be detected are highly correlated. The methods 
can be used for various signal detection applications with- 
out knowledge of the signal, the channel and noise power. 
Furthermore, different from matched filtering, the proposed 
methods do not require accurate synchronization. Simula- 
tions based on randomly generated signals, wireless micro- 
phone signals and captured digital television (DTV) signals 
are carried out to verify the effectiveness of the proposed 
methods. 

The rest of the paper is organized as follows. In Section 

II, the system model and some background information are 
provided. The sensing algorithms are presented in Section 

III. Section IV gives theoretical analysis and finds thresholds 
for the algorithms based on the RMT. Simulation results 
based on randomly generated signals, wireless microphone 
signals and captured DTV signals are given in Section V. 
Also some open questions are presented in this section. Con- 
clusions are drawn in Section VI. A pre-whitening technique 
is given in Appendix A for processing narrowband noise. Fi- 
nally, a proof is given in Appendix B for the equivalence of 
average eigenvalue and signal power. 

Some notations used in the paper are listed as follows: 
superscripts T and f stand for transpose and Hermitian 
(transpose-conjugate), respectively. Ig is the identity ma- 
trix of order q. 

2 System Model and Background 

Let Xc{t) — Sc{t) + T]cit) be the continuous-time received 
signal, where Sc(t) is the possible primary user's signal 
and rjcit) is the noise. ric(t) is assumed to be a station- 
ary process satisfying E(77c(i)) = 0, E{ri^{t)) ^ and 
'E{ric{t)ric{t + t)) = for any t ^ 0. Assume that we are 
interested in the frequency band with central frequency fc 
and bandwidth W. We sample the received signal at a sam- 
pling rate fs, where fs >W. Let = l//s be the sampling 



period. For notation simplicity, we define x{n) = Xc{nTs), 
s{n) = Sc{nTs) and ri{n) = rjc{nTs). There are two hy- 
pothesizes: Hq, signal does not exist; and Hi, signal exists. 
The received signal samples under the two hypothesizes are 
given respectively as follows [6] [3 [7] : 

Ha : x{n) = T]{n), (1) 
Hi : x{n) — s{n) + ri{n), (2) 

where s(n) is the received signal samples including the ef- 
fects of path loss, multipath fading and time dispersion, 
and 77(71) is the received white noise assumed to be iid, and 
with mean zero and variance . Note that s(ri) can be the 
superposition of signals from multiple primary users. It is 
assumed that noise and signal are uncorrelated. The spec- 
trum sensing or signal detection problem is to determine if 
the signal exists or not, based on the received samples x{n). 

Note: In above, we have assumed that the noise samples 
are white. In practice, if the received samples are the filtered 
outputs, the corresponding noise samples may be correlated. 
However, the correlation among the noise samples is only 
related to the receiving filter. Thus the noise correlation 
matrix can be found based on the receiving filter, and pre- 
whitening techniques can then be used to whiten the noise 
samples. The details of a pre-whitening method are given 
in Appendix A. 

Now we consider two special cases of the signal model. 

(i) Digital modulated and over-sampled signal. Let s{n) 
be the modulated digital source signal and denote the sym- 
bol duration as Tq. The discrete signal is filtered and trans- 
mitted through the communication channel [22l [23l [24] . 
The resultant signal (excluding receive noise) is given as 

|21[23[21] 

00 

Sc{t)= s{k)h{t~kTo), (3) 

fc— — 00 

where h{t) encompasses the effects of the transmission fil- 
ter, channel response, and receiver filter. Assume that h{t) 
has finite support within [O,^^]. Assume that the received 
signal is over-sampled by a factor M, that is, the sampling 
period is Ts = Tq/M. Define 

Xi{n) = x{{nM + i — 1)7^), 
hi{n) = h{{nM + i~l)T,), 
m{n)^T^,{{nM + i-l)Ts), (4) 

n = 0, 1,-- - ; i = 1,2,--- ,M. 

We have 

N 

Xi{n) ='Yhi{k)s{n - k) + rii{n), (5) 
fc=o 

where N — \Tu/Tq\. This is a typical single input multi- 
ple output (SIMO) system in communications. If there are 
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multiple source signals, the received signal turns out to be 



3 Eigenvalue based Detections 



P JVii 

^ii^) = '^^f^ij(k)sj(n - fc) + rii(n), (6) 

j=l k=0 

where P is the number of source signals, hij{k) is the chan- 
nel response from source signal j, and Nij is the order of 
channel hij{k). This is a typical multiple input multiple 
output (MIMO) system in communications. 

(ii) Multiple-receiver model. The model ([6]) is also ap- 
plicable to multiple-receiver case where Xi{n) becomes the 
received signal at receiver i. The difference between the 
over-sampled model and multiple-receiver model lies in the 
channel property. For over-sampled model, the channels 
/iy(fc)'s (for different i) are induced by the same channel 
hj{t). Hence, they are usually correlated. However, for 
multiple receiver model, the channel hij (k) (for different i) 
can be independent or correlated, depending on the antenna 
separation. Conceptually, the over-sampled and multiple- 
receiver models can be treated as the same. 

Model ^ can be treated as a special case of model ^ 
with M — P = 1 and Nij = 0, and s(n) replaced by s{n). 
For simplicity, in the following, we only consider model ([6]). 
Note that the methods are directly appHcable to 
model {[2]) with M = P = 1 (later the simulation for 
wireless microphone is based on this model). 

Energy detection is a basic sensing method |lTl [H [121 E] . 
Let T{Ns) be the average power of the received signals, that 
is, 

M Ns-1 

where Ns is the number of samples. The energy detection 
simply compares T{Ns) with the noise power to decide the 
signal existence. Accurate knowledge on the noise power is 
therefore the key to the success of the method. Unfortu- 
nately, in practice, the noise uncertainty always presents. 
Due to the noise uncertainty [HI [SI [IH] , the estimated noise 
power may be different from the actual noise power. Let 
the estimated noise power be — aa"^. We define the 
noise uncertainty factor (in dB) as 

S = max{101ogi(,a}. (8) 

It is assumed that a (in dB) is evenly distributed in an 
interval [—B,B] [6l[l7]. In practice, the noise uncertainty 
factor of receiving device is normally 1 to 2 dB The 
environment noise uncertainty can be much higher due to 
the existence of interference [5]. When there is noise un- 
certainty, the energy detection is not an effective method 
[21 [g [ini [17] due to the existence of SNR wall and/or high 
probability of false alarm. 



Let Nj = max{Nij). Zero-padding hij{k) if necessary, and 

i 

defining 

x{n)'^= [xi{n),X2{n),- ■ ■ ,XMin)]'^, (9) 
hj(?i) =^ [hij{n),h2jin),- ■ ■ ,hMj{n)]^ , (10) 
T7(n) [77l(r^),7/2(f^), ■ ■ • (H) 
we can express ([6|) into a vector form as 

P 

^('^) =mzhj(^)*j "=o,i,-- - . (12) 

3 = 1 k=0 

Considering L (called "smoothing factor" ) consecutive out- 
puts and defining 

x(n) [x^(n), x^(n - 1), • • • , x^(n -L + 1)]^, 

r){n) [r^^{n\ r^^ {n - 1), ... , r^^ {n -L + l)f , 

s{n) =^ [si{n),si{n -!),■■■ ,si{n - Ni - L + 1), - ■ ■ , 

sp{n),sp{n - 1), ... , sp{n ~Np-L + 1)]^, (13) 

we get 

x(n) = Hs(n) + J7(n), (14) 
, f P 

where H is a ML x {N + PL) {N " ^ Nj) matrix defined 
as 

H [Hi,H2,-.- ,Hp], (15) 

r hj(0) \i,{N,) ■■■ - 

=^ ■ . ^ ■ . ^ . (16) 

■•• hj(0) 

Note that the dimension of is ML x {Nj + L) . 

Define the statistical covariance matrices of the signals 
and noise as 

= E(x(n)xt(n)), (17) 
R, =E(s(n)st(n)), (18) 
R^ = E(7)(n)7?t(„)). (19) 

We can verify that 

H^^WRs^^ +(t11ml. (20) 

where cr^ is the variance of the noise, and Iml is the identity 
matrix of order ML. 

3.1 The algorithms 

In practice, we only have finite number of samples. Hence, 
we can only obtain the sample covariance matrix other than 
the statistic covariance matrix. Based on the sample covari- 
ance matrix, we propose two detection methods as follows. 
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Algorithm 1 Maximum- minimum eigenvalue (MME) de- 
tection 

Step 1. Compute the sample covariance matrix of the 
received signal 

L-2+N, 

^.{Ns) = J- E x(n)xt(n), (21) 

^ n=L-l 

where Ng is the number of collected samples. 

Step 2. Obtain the maximum and minimum eigenvalue of 
the matrix 'R.xiNs), that is, Xmax and Xmin- 

Step 3. Decision: if Xmax /Xmin > 7i, signal exists 
("yes" decision); otherwise, signal does not exist ("no" 
decision), where 71 > 1 is a threshold, and will be given in 
the next section. 

Algorithm 2 Energy with minimum eigenvalue (EME) de- 
tection 

Step 1. The same as that in Algorithm]^ 

Step 2. Compute the average power of the received signal 
T{Ns) (defined in ^), and the minimum eigenvalue Xmin 
of the matrix (TVs ) . 

Step 3. Decision: if T{Ns)/Xmin > 72, signal exists 
("yes" decision); otherwise, signal does not exist ("no" de- 
cision), where 72 > 1 is a threshold, and will be given in the 
next section. 

The difference between conventional energy detection and 
EME is as follows: energy detection compares the signal 
energy to the noise power, which needs to be estimated in 
advance, while EME compares the signal energy to the min- 
imum eigenvalue of the sample covariance matrix, which is 
computed from the received signal only. 

Remark: Similar to energy detection, both MME and 
EME only use the received signal samples for detections, 
and no information on the transmitted signal and channel is 
needed. Such methods can be called blind detection meth- 
ods. The major advantage of the proposed methods over 
energy detection is as follows: energy detection needs the 
noise power for decision while the proposed methods do not 
need. 

3.2 Theoretical analysis 

Let the eigenvalues of R^; and HRsH^ be Ai > A2 > • • • > 
Xml and pi > p2 > ■■■ > pml, respectively. Obviously, 
Xn = Pn + crfy When there is no signal, that is, s{n) — 
(then Rs = 0), we have Ai = A2 = • • • = Xml = <J^. Hence, 
Xi/Xml = 1- When there is a signal, if pi > pml, we 
have Xi/Xml > 1- Hence, we can detect if signal exists 
by checking the ratio Xi/Xml- This is the mathematical 
ground for the MME. Obviously, pi = pml if and only if 
HRsHt = XIml, where A is a positive number. From the 
definition of the matrix IH and R^., it is highly probable that 



HRgH^ ^ XIml- In fact, the worst case is R^ = cr^I, that 
is, the source signal samples are iid. At this case, HRsHt = 
o-^HHt. Obviously, cr^HHt = AIa/l if and only if all the 
rows of H have the same power and they are co-orthogonal. 
This is only possible when Nj = 0, j — 1, ■ ■ ■ , P and M — 1, 
that is, the source signal samples are iid, all the channels 
are flat-fading and there is only one receiver. 

If the smoothing factor L is sufficiently large, L > 
N/{M - P), the matrix H is taU. Hence 

Pn = 0, A„ = (7^, 71 = TV + PL + 1, • • • , ML. (22) 

At this case, Ai = pi + crjj > Xml — fj^, and furthermore 
the minimum eigenvalue actually gives an estimation of the 
noise power. This property has been successfully used in 
system identification [23,^25] and direction of arrival (DOA) 
estimation (for example, see [21], page 656). 

In practice, the number of source signals (P) and the 
channel orders usually are unknown, and therefore it is dif- 
ficult to choose L such that L > N/{M — P). Moreover, to 
reduce complexity, we may only choose a small smoothing 
factor L (may not satisfy L > N/{M — P)). At this case, 
if there is signal, it is possible that pml 7^ 0. However, as 
explained above, it is almost sure that pi > pml and there- 
fore, Xi/Xml > 1- Hence, we can almost always detect the 
signal existence by checking the ratio Xi/Xml- 

Let A be the average of all the eigenvalues of R^^. For 
the same reason shown above, when there is no signal, 
^/Xi\iL = 1, and when there is signal. A/ Xml > 1- Hence, 
we can also detect if signal exists by checking the ratio 
A/ Xml- 

The average eigenvalue A is almost the same as the signal 
energy (see the proof in the appendix B). Hence, we can use 
the ratio of the signal energy to the minimum eigenvalue for 
detection, which is the mathematical ground for the EME. 

4 Performance Analysis and Detec- 
tion Threshold 

At finite number of samples, the sample covariance matrix 
Rx{Ns) may be well away from the statistical covariance 
matrices R^,. The eigenvalue distribution of Rx(As) be- 
comes very complicated [HI [191 1201 EI]- This makes the 
choice of the threshold very difficult. In this section, we will 
use some latest random matrix theories to set the threshold 
and obtain the probability of detection. 

Let Pd be the probability of detection, that is, at hypoth- 
esis Hi, the probability of the algorithm having detected 
the signal. Let Pfa be the probability of false alarm, that 
is, at Hq, the probability of the algorithm having detected 
the signal. Since we have no information on the signal (ac- 
tually we even do not know if there is signal or not), it is 
difficult to set the threshold based on the Pd- Hence, usually 
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we choose the threshold based on the Pfa ■ The threshold is 
therefore not related to signal property and SNR. 

4.1 Probability of false alarm and thresh- 
old 

When there is no signal, Il^{Ns) turns to R^(A^5), the sam- 
ple covariance matrix of the noise defined as, 



(23) 



It is generally difficult to evaluate it. Fortunately, there 
have been tables for the functions [19] and Matlab codes 
to compute it [25]. Table [T] gives the values of Fi at some 
points. It can also be used to compute the inverse F^^ at 
certain points. For example, F~^{0.9) = 0.45, i^f ^(0.95) = 
0.98. 

Using the theories, we are ready to analyze the algo- 
rithms. The probability of false alarm of the MME detection 
is 



'Rrj{Ns) is nearly a Wishart random matrix [18 . The study 
of the spectral (eigenvalue distributions) of a random matrix 
is a very hot topic in recent years in mathematics as well as 
communication and physics. The joint probability density 
function (PDF) of ordered eigenvalues of a Wishart random 
matrix has been known for many years |18j . However, since 
the expression of the PDF is very complicated, no closed 
form expression has been found for the marginal PDF of 
ordered eigenvalues. Recently, I. M. Johnstone and K. Jo- 
hansson have found the distribution of the largest eigenvalue 
[19l [20] as described in the following theorem. 

Theorem 1. Assume that the noise is real. Let A{Ns) = 
^R^iN,), fi = {^NT^+VML)^ and = 

1 I 1 ^l/3 A K-i^ ML 




P 



iA{N,)) > 7iA™„ j 
/MLf - li\ 



1-Fi 



Vml){- 



y 



< 1). Then 



-I- 



A^a^(A(JV,)) 



Assume that lim 



(TAW-f 
yiO< 



This leads to 



converges (with probability or, equivalently. 



one) to the Tracy- Widom distribution of order 1 (Wi) [2S1 
[27]. 

Bai and Yin found the limit of the smallest eigenvalue 
[21] as described in the following theorem. 



= F-\\-Pfa) 



(26) 



(27) 



(28) 



Theorem 2. 

Arri,7 



Then lim 



Assume that lim = y (0 < ?/ < 1). 

alii- 



From the definitions of /x and v, we finally obtain the thresh- 
old 



V 



^/y) (with probability one). 

Based on the theorems, when Ng is large, the largest and 
smallest eigenvalues of RniNs) tend to deterministic values 

^^{y/K+^MLf and ^(V^^ 



V ML)"^, respectively, 
that is, they are centered at the values, respectively, and 
have variances tend to zeros. Furthermore, Theorem 1 gives 
the distribution of the largest eigenvalue for large A^^- 

The Tracy- Widom distributions were found by Tracy and 
Widom (1996) as the limiting law of the largest eigenvalue 
of certain random matrices [26l [27] . Let Fi be the cumula- 
tive distribution function (CDF) (sometimes simply called 
distribution function) of the Tracy- Widom distribution of 
order 1. There is no closed form expression for the distri- 
bution function. The distribution function is defined as 



7i 



-[^^ (Ar,ML)V6 ^1 



(29) 



Please note that, unlike energy detection, here the 
threshold is not related to noise power. The thresh- 
old can be pre-computed based only on A^^, L and 
Pfa, irrespective of signal and noise. 

Now we analyze the EME method. When there is no 
signal, it can be verified that the average energy defined in 
([7]) satisfies 



i^i(i) -exp 



1 



[q{u) + {u ~ t)q^{u)) du 



(24) 



E(T(Ar,)) = Var(T(Ar,)) 



(30) 



where q{u) is the solution of the nonlinear Painleve II dif- 
ferential equation 



q"{u) =uq{u) + 2q^{u). 



(25) 



T{Ns) is the average of MNg statistically independent and 
identically distributed random variables. Since A^^ is large, 
the central limit theorem tells us that T{Ns) can be ap- 
proximated by the Gaussian distribution with mean and 
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t 


-3.90 


-3.18 


-2.78 


-1.91 


-1.27 


-0.59 


0.45 


0.98 


2.02 


Flit) 


0.01 


0.05 


0.10 


0.30 


0.50 


0.70 


0.90 


0.95 


0.99 



Table 1: Numerical table for the Tracy- Widom distribution of order 1 



variance 



Hence the probability of false alarm is 



For the MME method, the is 



P 



Pfa = P {T{Ns) > 

N, 



Prl 



T(iV,) >72^( 



VMLf 



P{X 

ma 

l-Fi 



,(R^(iV,)) > ^iXraU^xiNs))) 
,(R^(7Vs)) > 7i(pAfL + cr,^) - Pi) 

1 7iiVs + NsijipML - Pi)/o-^n - M 



(38) 



P 



TiNs) 



where 



Q 



Q{t) 



72 



Mi^/Ws - VML)^ - VMN, 



1 



+ 00 



/2n: 



-"'/2dl 



V27r jt 

Hence, we should choose the threshold such that 



(32) 



From the formula, the Pd is related to the number of sam- 
ples Ns , and the maximum and minimum eigenvalues of the 
signal covariance matrix (including channel effect). 
(^32) Both the Pd and threshold 71 in (|29p are related to L 
and Ng. For fixed Ns and Pfa, the optimal L is the one 
which maximizes the Pd- Based on and (|38p , we can 
find that optimal L. However, the optimal L does not have 
high practical value because it is related to signal property 
which is usually unknown at the receiver. 
As proved in Appendix B, 



72 VM(ViV7 - ^/ML)'^ - VmNs 



= Q-'{Pfa). (33) 



That is. 



72 



Q-\Pfa).flN's + VMN: 



■Q-\Pfa) 



1-1 



(VTvI- Vml)2 



(34) 



Similar to MME, here the threshold is not related 
to noise power. The threshold can be pre-computed 
based only on Ns, L and Pfa, irrespective of signal 
and noise. 

4.2 Probability of detection 

When there is a signal, the sample covariance matrix 
R.a;(A^s) is no longer a Wishart matrix. Up to now, the 
distributions of its eigenvalues are unknown. Hence, it is 
very difficult (mathematically intractable) to obtain a pre- 
cisely closed form formula for the Pd- In this subsection, we 
try to approximate it and devise some empirical formulae. 
Since Ng is usually very large, we have the approximation 



R,(iV,)«IHIR,Ht + R„(7V,). 



(35) 



Note that R^(A^s) approximates to a'ilML- Hence, we have 



.(Rx(iVs)) 
.(R.(iV.)) 



Pi + A 
Pail 



V 

max (r^T? (-^s )) 5 
2 



(36) 
(37) 



TiNs) 



Tr(R^(jV,)) 
AIL 

Tr(HR,Ht) Tr(R„(Ar,)) 



ML ■ ML ' ^^^^ 

where Tr(-) means the trace of a matrix. As discussed in 
the last subsection, the minimum eigenvalue of R^iNs) is 

_2 

/]Vs - VmL)'^. Hence, equation is 



approximately 



an over-estimation for the minimum eigenvalue of R^(A^s)- 

^2 

On the other hand, pml + -^iV^^— vML)'^ is obviously 
an under-estimation. Therefore, we choose an estimation 
between the two as 

Xmin (Ra; i-^s)) 



PML + ^i^s-^ML). (40) 



/N, 

Based on (I39p and (|40p . we obtain an approximation for the 
Pd of EMEas 



P(T(Ar,) >72A„„,(R,(Ar,))) 
Trill^iNs)) 



(41) 



ML 



> 72 I Pml + ■ 

Q - 
\ 



72 Pml + ■ 



/ML) j 



Tr(HRset) 



AIL 

Tr(HR3Ht) _ ^2 \ 



/ 2 
MNs 



J 

From the formula, the Pd is related to the number of samples 
Ns , and the average and minimum eigenvalues of the signal 
covariance matrix (including channel effect). 

Similarly, for fixed Ns and Pfa, we can find the optimal 
L based on (l34| and (|4T1). 
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4.3 Computational complexity 

The major complexity of MME and EME comes from two 
parts: computation of the covariance matrix (equation (HH) 
and the eigenvalue decomposition of the covariance matrix. 
For the first part, noticing that the covariance matrix is a 
block Toeplitz matrix and Hermitian, we only needs to eval- 
uate its first block row. Hence M'^LNg multiplications and 
M'^L{Ns — 1) additions are needed. For the second part, 
generally 0((ML)^) multiplications and additions are suffi- 
cient. The total complexity (multiplications and additions, 
respectively) are therefore as follows: 



NrLNs + O(A'FL^). 



(42) 



Since Ns is usually much larger than L, the first part is 
dominate. 

The energy detection needs MNs multiplications and 
M{Ns — \) additions. Hence, the complexity of the proposed 
methods is about ML times that of the energy detection. 

5 Simulations and Discussions 

In the following, we will give some simulation results using 
the randomly generated signals, wireless microphone signals 
[25] and the captured DTV signals [30] ■ 

5.1 Simulations 

We define the SNR as the ratio of the average received signal 
power to the average noise power 



g^j^dcf E(||x(n)-r,(n)||2) 



E(|Kn)||^ 



(43) 



We require the probability of false alarm Pfa ^0.1. Then 
the threshold is found based on the formulae in Section 
IV. For comparison, we also simulate the energy detection 
with or without noise uncertainty for the same system. The 
threshold for the energy detection is given in [6J. At noise 
uncertainty case, the threshold is always set based on the 
assumed/estimated noise power, while the real noise power 
is varying in each Monte Carlo realization to a certain de- 
gree as specified by the noise uncertainty factor defined in 
Section II. 

(1) Multiple-receiver signal detection. We consider a 
2-input 4-receiver system (M = 4, P = 2) as defined by (O. 
The channel orders are iVi = A^2 = 9 (10 taps). The channel 
taps are random numbers with Gaussian distribution. All 
the results are averaged over 1000 Monte Carlo realizations 
(for each realization, random channel, random noise and 
random BPSK inputs are generated). 

For fixed L = 8 and TV^ = 100000, the Pd for the MME 
and energy detection (with or without noise uncertainty) are 
shown in Figure [H where and in the following "EG-x dB" 




-e- EG-2dB 

EG-1.5dB 
-•- EG-ldB 
-A- EG-0.5dB 

EG-OdB 

O' EME 
-O- EME-theo 

MME 
MME-theo 



-4 -2 



Figure 1: Probabihty of detection: M = 4, P = 2, L = 8. 



means the energy detection with x-dB noise uncertainty. 
If the noise variance is exactly known [B = 0), the energy 
detection is very good (note that it is optimal for iid signal) . 
The proposed methods are slightly worse than the energy 
detection with ideal noise power. However, as discussed in 
[HI El I31j . noise uncertainty is always present. As shown 
in the figure, if there is 0.5 to 2 dB noise uncertainty, the 
detection probability of the energy detection is much worse 
than that of the proposed methods. From the figure, we 
see that the theoretical formulae in Section IV. B for the Pd 
(the curves with mark "MME-theo" and "EME-theo") are 
somewhat conservative. 

The Pfa is shown in Tabled (second row) (note that Pfa is 
not related to the SNR because there is no signal) . The Pfa 
for the proposed methods and the energy detection without 
noise uncertainty almost meet the requirement {Pfa ^ 0.1), 
but the Pfa for the energy detection with noise uncertainty 
far exceeds the limit. This means that the energy detection 
is very unreliable in practical situations with noise uncer- 
tainty. 

To test the impact of the number of samples, we fix the 
SNR at -20dB and vary the number of samples from 40000 
to 180000. Figure [2] and Figure [3] show the P<j and P/a, re- 
spectively. It is seen that the Pd of the proposed algorithms 
and the energy detection without noise uncertainty increases 
with the number of samples, while that of the energy detec- 
tion with noise uncertainty almost does not change (this 
phenomenon is also verified in [101 117] ) . This means that 
the noise uncertainty problem cannot be solved by increas- 
ing the number of samples. For the P/a, all the algorithms 
do not change much with varying number of samples. 

To test the impact of the smoothing factor, we fix the 
SNR at -20dB, = 130000 and vary the smoothing fac- 
tor L from 4 to 14. Figure d] shows the results for both 
Pd and Pfa- It is seen that both Pd and P/a of the pro- 
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method 


EG-2 dB 


EG-1.5 dB 


EG-1 dB 


EG-0.5 dB 


EG-OdB 


EME 


MME 


Pfa (M = i, P = 2, L = 8, Ns = 10^) 


0.499 


0.499 


0.498 


0.495 


0.104 


0.065 


0.103 


Pj^ {M ^ P ^1, 10, Ns^bx 10") 


0.497 


0.496 


0.488 


0.470 


0.107 


0.019 


0.074 


Pfa (Af = 2, F = 1, L = 8, iV, = 5 X 10") 


0.499 


0.499 


0.497 


0.486 


0.097 


0.028 


0.072 



Table 2: Probability of false alarm at different parameters 



■ EG-2dB 

■ EG-1.5dB 

■ EG-ldB 

■ EG-0.5dB 

■ EG-OdB 
EME 
MME 



Number of samples 



Figure 2: Probability of detection: 
SNR=-20 dB. 



Af = 4, P - 2, L 8, 



0.5,^. 



■ EG-2dB 

■ EG-1.5dB 

■ EG-ldB 

■ EG-0.5dB 

■ EG-OdB 
EME 
MME 



Number of samples 



Figure 3: Probability of false alarm: M ^ 4, P ~ 2, L ~ 8. 




A- EG-0,5dB {P^J 
— EG-OdB {P^f 
^ EME (P,^) 
^ MME {p'^J 
A. EG-0.5dB (P^) 
_, EG-OdB (P^) 
^ , EME (P^) 
^, MME(P ) 



Smoothing factor 



Figure 4: Impact of smoothing factor: 
SNR=-20 dB, Ns = 130000. 



M 



4. P 



posed algorithms slightly increase with L, but will reach a 
ceiling at some L. Even if L ^ N/ {M — P) — 9 , the meth- 
ods still works well (much better than the energy detection 
with noise uncertainty). Noting that smaller L means lower 
complexity, in practice, we can choose a relatively small L. 
However, it is very difficult to choose the best L because it 
is related to signal property (unknown). Note that the Pd 
and Pfa for the energy detection do not change with L. 

(2) Wireless microphone signal detection. FM mod- 
ulated analog wireless microphone is widely used in USA 
and elsewhere. It operates on TV bands and typically occu- 
pies about 200KIIz (or less) bandwidth ^29j. The detection 
of the signal is one of the major challenge in 802.22 WRAN 
|5] . In this simulation, wireless microphone soft speaker sig- 
nal [29] at central frequency fc = 200 MHz is used. The 
sampling rate at the receiver is 6 MHz (the same as the 
TV bandwidth in USA). The smoothing factor is chosen as 
L ~ 10. Simulation results are shown in Figure [5] and Table 
[5] (third row for Pfa)- From the figure and the table, we see 
that all the claims above are also valid here. Furthermore, 
here the MME is even better than the ideal energy detec- 
tion. The reason is that here the signal samples are highly 
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■ EG-2dB 

■ EG-1.5dB 

■ EG-ldB 

■ EG-0.5dB 

■ EG-DdB 
EME 
MME 



-22 -20 -18 



-14 -12 -10 
SNR (dB) 



-14 -12 -10 
SNR (dB) 



Figure 5: Probability of detection for wireless microphone 
signal. 




EME {SNR— 15dB) 
★ ' MME (SNR— 15dB) 



10"^ 10"^ 10 ' 

Probability of false alarm 

Figure 6: ROC curve for wireless microphone signal: Ng = 
50000. 

correlated and therefore energy detection is not optimal. 

The Receiver Operating Characteristics (ROC) curve is 
shown in Figure [6l where the sample size is Ng = 50000. 
Note that we need slightly adjusting the thresholds to keep 
all the methods having the same Pfa values (especially for 
the energy detection with noise uncertainty, the threshold 
based on the predicted noise power and theoretical formula 
is very inaccurate to obtain the target Pfa as shown in Table 
[2|). It shows that MME is the best among all the methods. 
The EME is worse than the ideal energy detection but better 
than the energy detection with noise uncertainty 0.5 dB. 

(3) Captured DTV signal detection. Here we test the 
algorithms based on the captured ATSC DTV signals [50] . 
The real DTV signals (field measurements) are collected at 
Washington D.C. and New York, USA, respectively. The 
sampling rate of the vestigial sideband (VSB) DTV signal 



Figure 7: Probability of detection for DTV signal WAS- 
003/27/01. 

is 10.762 MHz [32]. The sampling rate at the receiver is two 
times that rate (oversampling factor is 2). The multipath 
channel and the SNR of the received signal are unknown. 
In order to use the signals for simulating the algorithms at 
very low SNR, we need to add white noises to obtain various 
SNR levels [31] . In the simulations, the smoothing factor is 
chosen as L = 8. The number of samples used for each test 
is 2Ns — 100000 (corresponding to 4.65 ms sampling time). 
The results are averaged over 1000 tests (for different tests, 
different data samples and noise samples are used). Figure 
[Tlgives the Pd based on the DTV signal file WAS-003/27/01 
(at Washington D.C, the receiver is outside and 48.41 miles 
from the DTV station) [30]. Figure [8] gives the results based 
on the DTV signal file NYC/205/44/01 (at New York, the 
receiver is indoor and 2 miles from the DTV station) [30] . 
Note that each DTV signal file contains data samples in 25 
seconds. The Pfa are shown in Table [2] (fourth row). The 
simulation results here are similar to those for the randomly 
generated signals. 

In summary, all the simulations show that the proposed 
methods work well without using the information of signal, 
channel and noise power. The MME is always better than 
the EME (yet theoretical proof has not been found). The 
energy detection are not reliable (low probability of detec- 
tion and high probability of false alarm) when there is noise 
uncertainty. 

5.2 Discussions 

Theoretic analysis of the proposed methods highly relies on 
the random matrix theory, which is currently one of the hot 
topic in mathematics as well as in physics and communica- 
tion. We hope advancement on the random matrix theory 
can solve the following open problems. 

(1) Accurate and analytic expression for the Pd at given 




EG-2dB 
^ EG-1.5dB 
■«- EG-ldB 
A- EG-0.5dB 
— EG-OdB 
O EME 

MME 



Figure 8: Probability of detection for DTV signal 
NYC/205/44/01. 



threshold. This requires the eigenvalue distribution of ma- 
trix Ra;(A^s) when both signal and noise are present. At this 
case, ILxiNs) is no longer a Wishart random matrix. 

(2) When there is no signal, the exact solution of 
P{^max/ ^min > ■ This is the Pfa- That is, we need to 
find the distribution of Xmax/^min- As we know, this is still 
an unsolved problem. In this paper, we have approximated 
this probability through replacing Xmm by a deterministic 
number. 

(3) Strictly speaking, the sample covariance matrix of the 
noise R^(A^s) is not a Wishart random matrix, because the 
fj{n) for different n are correlated. Although the correla- 
tions are weak, the eigenvalue distribution may be affected. 
Is it possible to obtain a more accurate eigenvalue distribu- 
tion by using this fact? 



6 Conclusions 



before the filter, which are assumed to be independent and 
identically distributed (i.i.d). Let /(fc), k — 0,1, ■ ■ ■ , K , he 
the filter. After filtering, the noise samples turns to 



K 



Vin) = ^ f(k)f]{n - fc), n = 0, 1, 



k=0 



Consider L consecutive outputs and define 
?7(n) = [77(71), ■■■ ,fi{n-L + 



(44) 



(45) 



The statistical covariance matrix of the filtered noise be- 
comes 

R, =E(,7(n)r7(7i)t)=a2HHt, (46) 



where H is a L x (L + K) matrix defined as 



H : 



/(O) /(I) 
/(O) 



f{K) 
f(K - 1) f{K) 



/(O) 



/(I) 



(47) 



Let G = HH^. If analog filter or both analog and digital 
filters are used, the matrix G should be defined based on 
those filter properties. Note that G is a positive definite 
Hermitian matrix. It can be decomposed to G = Q^, where 
Q is also a positive definite Hermitian matrix. Hence, we 
can transform the statistical covariance matrix into 



Q ^ R,j Q 



2t 



(48) 



Note that Q is only related to the filter. This means that 
we can always transform the statistical covariance matrix 
Rj; in (jl7|) (by using a matrix obtained from the filter) such 
that equation ((20|) holds when the noise has been passed 
through a narrowband filter. Furthermore, since Q is not 
related to signal and noise, we can pre-compute its inverse 
Q^^ and store it for later usage. 



Methods based on the eigenvalues of the sample covariance Appendix B 
matrix of the received signal have been proposed. Latest 
random matrix theories have been used to set the thresholds 
and obtain the probability of detection. The methods can 
be used for various signal detection applications without 
knowledge of signal, channel and noise power. Simulations 
based on randomly generated signals, wireless microphone 
signals and captured DTV signals have been done to verify 
the methods. 



It is known that the summation of the eigenvalues of a ma- 
trix is the trace of the matrix. Let A(7Vs) be the average of 
the eigenvalues of Ra;(iVs). Then 



A(7V, 



1 



ML 



Tr(R,(7V,)) 



1 



MLN, 



x^(ri)x(7 



(49) 



Appendix A 

At the receiving end, usually the received signal is filtered by 
a narrowband filter. Therefore, the noise embedded in the 
received signal is also filtered. Let rj{n) be the noise samples 



After some mathematical manipulations, we obtain 

M L-2+Ns 

TWT. J2 Sim)\x,im)\\ (50) 



MLN, 



= 1 m=0 
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where 

{rn+1, <m< L-2 

L, L-l<m<Ns-l (51) 

Ns + L-m-1, Ns<m<Ns + L-2 

Since Ns is usually much larger than L, we have 

A(A^.)«^^ E I^.MP^W)- (52) 

2—1 m— 
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